Directiveness as a Cause of Response Bias: Evidence From Two Survey Experiments

Extant research comparing survey self-reports of normative behavior to direct observations and time diary data have yielded evidence of extensive measurement bias. However, most of this research program has relied on observational data, comparing independent samples from the same target population, rather than comparing survey self-reports to a criterion measure for individual respondents. This research addresses the next step using data from two studies. In each study, respondents completed a conventional survey questionnaire, including questions about frequency of religious behavior. Respondents were then asked to participate in a text messaging (short message service) data collection procedure, reporting either (1) participation in religious behavior specifically or (2) all changes in major activity without explicitly specifying religious behavior. Findings suggest that directive measurement, priming the respondent to consider the focal behavior, is a cause of measurement bias. 1 University of Massachusetts Boston, Boston, MA, USA 2 University of Wisconsin, Madison, WI, USA Corresponding Author: Philip S. Brenner, University of Massachusetts Boston, 100 William T. Morrissey Blvd, Boston, MA 02125, USA. Email: [email protected] Sociological Methods & Research 1-24 a The Author(s) 2014 Reprints and permission: sagepub.com/journalsPermissions.nav DOI: 10.1177/0049124114558630 smr.sagepub.com at UNIV OF WISCONSIN-MADISON on November 26, 2014 smr.sagepub.com Downloaded from